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Abstract 

In this article, the author reviews some of the literature around certification 
programs. He then expresses a concern over the unilateral implementation of such a 
program by an evaluation organization like AEA. Such a move could low er the 
economic incentives that evaluators from developing countries would have to join their 
own regional or national evaluation or ganizations. This could dele gitimize all of the 
other regional and national evaluations around th e world and ultimatel y fragment the 
profession. The solution that is offered is fo r regional and national ev aluation 
organizations to work together through the future International Organization for 
Cooperation in Evaluation ( lOCE) to collective! y implement a certific ation or 
credentialing program. 
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A Conditional Case for Certification/ Licensure 
Like most evaluators, I have listened to the pros a nd cons of the certification 
debate with great interest. Arnold Love provided an early (1994) assessment of the 
issues. According to him, the essenc e of certification involves: 

. . . the assessment b y professional peers of the applicant’s competence 
against standards a ccepted within the profession. The succ essful applicant 
then receives a written certificate from a recognized body, usually a 
professional associ ation. (pg. 29) 

Love identified two majo r approaches to certification: the professional 
development appro ach and the licensing approach. The former emphasizes that 
the central purpose of certification is to provide assurance o f an individual’ s 
knowledge, compet encies, and application of the profession’ s standards of 
practice and code of ethics. The latter employs a regulatory approach by granting 
licenses to practic e. Sanctions are enforced for those who practice without the 
required license. 

1997 Board Report 

More recently, the Forum section of a volume of AJE (Fall, 1999) was dev oted to 
the topic. James Altschuld (1999) present ed highlights from a 1997 report on 
certification that was sub mitted to the B oard of Directors of the American Evaluation 
Association. Acco rding to him, the report stated that most professions hav e some kind 
of formal, usually accredited, training. Often apprenticeship-like experiences such as 
practicums or internships are required. At the conclusion of the training , a test or 
examination is usuall y administered. Certification has costs (a minimum fig ure of 
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US$100 was quoted) ass ociated with it. These w ould not be one-time fe es because 
certification would need to be renewed periodically. Responsibility for certification often 
resides in a professional society or association. Putting all of the pieces of a certification 
scheme in place would be a time consuming process. It was anticipated that it could take 
seven years or longer. 

Altschuld went on to outline possible nex t steps for AEA regarding certification. 
These include: 

1 . Maintain the status quo. 

2. Immediately proceed to develop an examination to be used for 
certification purposes. 

3. Develop a plan for accreditation only, which would serve as a half-way 
step between maintainin g the status quo and certifi cation. 

4. Develop a plan th at includes a reasonable timetabl e for certification that 
would link certification with accreditation. 

5. Consider adopting a system of “credentialing” similar to the one 
developed and us ed in Canada. 

6. Consider forming partnerships to defray the costs of both accreditation and 
certification. 

7. Consider sponsoring a conference to examine the i ssue of what are the 
unique value-add ed dimensions of the field of eval nation and training in 
evaluation, especially as they would pertain to certifying evaluators. 
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8. Consider using an issue of the American Journal of Evaluation for a 

pro/con discussion of the issues surrounding accreditation and certification 
or credentialing. 

Credentialing a Good Start 

Altschuld (2001) believe s adopting a credentialing system would be a good way 
for AEA to start the certification process. Credentialing implies that a pers on has studied 
a field and complet ed specified courses and activities in that field. In order to credential 
evaluators, a professional association would specify prerequisites, such as training in 
methods, academic d egrees, work experience, and other specialized experiences, that an 
individual must have (Altschuld, 1999). Altschuld (1999) cites Canad a as a successful 
model of credentialing. 

The Canadian s ystem requires that evaluators su ccessfully participate in 
four daylong workshops, with the content havin g been chosen on the basis 
of commonly accepted evaluation activities and p rinciples .... An 
established evaluator would take part in the traini ng as a form of review of 
or reinforcement for concepts and ideas with which they should be very 
familiar. F or less establi shed evaluators the four workshops would ensure, 
especially to outside audiences, that credentialed evaluators had been 
exposed to and trained at a basic level in ke y evaluation areas. While the 
Canadian system had other, more extensive training options, its major 
component consisted of t he four workshops, (p. 5 08) 

Altschuld (1999) envisions this credentialing system as being entirely voluntary 
Just as the Canadian s ystem is voluntary (Porteous, 2001). He concedes the possibility 
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that numerous individuals will simpl y continue to call themselves ev aluators without the 
benefit of credentials. However, he hopes that a “press” would gradually emerge for 
those who consider them selves to be professional evaluators to pursue credentialization 
(Altschuld, 1999). Altsc huld’s hope is my fear. In the following section, I assert that this 
“press” could have negative implications for re gional and national ev aluation 
organizations around the world. 

XCeval Discussion 

The entire certification debate was reframed for me by a recent discussion that 
took place on XC-ev al, a listserv for persons with i nterest in international an d cross- 
cultural evaluation. On September 1 0, Paul Clements, Professor of International 
Development at Western Michigan University, posted a message dealing with reform of 
the World Bank. His fascinating analysis (Clements, 2001) is still availabl e in the 
XCeval archives. Among the recommendations that Clements (2001) mad e was to 
improve the Bank’ s evaluation function. He state d: 

A possible direction for reform would be the d evelopment of an evaluation 
association that defines it self by a set of standards. It would have to have 
an exam. It would focus on impact evaluations, an d its members could 
only apply the association’s stamp to evaluations that are comprehensive 
in scope and that hav e access to all relevant records and persons. The id ea 
is that development proje cts should be judged by consistent, results- 
oriented standards, and evaluators should make th eir best professional 
estimates of the quantit y and quality of the project’s likely impacts. This 
would provide a much str onger foundation fo r ongoing country strategy 
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and for the design of subsequent projects, and it w ould build in an 
incentive for proj ect managers and supervisors to focus on impacts. 

Therefore if I, a certified/licensed evaluator, sign my name to an 
evaluation, I am vouching that the evaluation adheres to the association’s 
standards, at pain of th e loss of my certification/license. 

While I agreed with Clement’s analysis, I disagreed with his recommendat ions 
(Russon, 2001). I argued that this could have a det rimental impact upon the evaluation 
profession. To understand my rationale, you must know that, over the past s ix years or 
so, the number of regional and national ev aluation organizations has increased 
exponentially. Today, by my count, there are more than 40 evaluation organizations 
around the world (see the following URL: http://home.wmis.net/~russon/ioce/eor g.htm). 

If a new evaluation organization, such The World Bank/UNDP supported IDEAS 
or an existing evaluation organization, such as AEA, unilaterally put a certification 
scheme into place, I think that it could deleg itimize many of the regional and national 
evaluations around the world. How? If you were a large development agency and you 
had to choose between hiring an evaluator who was CERTIFIED by a western evaluation 
organization and one who came from a developing country without such a certification, 
which would you choose? 

This could result in a “ press” to Join IDEAS or AEA in order to accrue the real or 
perceived economic benefits of certification. Evaluators from dev eloping countries 
would have little or no incentive to Join their own regional or national evaluation 
organizations. The effect could be devastatin g for new regional and national evaluation 
organizations that are springing up in the developing world. I can envision a scenario in 
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which these organizations are depopul ated as quic kly as they are formed. If they 
survived at all, they would be weak and underresourced. 

Regional and national evaluation organizations that lacked a certification scheme 
could come to be se en as inferior. Should the seen ario unfold as outlined ab ove, I believe 
that a likely outcome would be a certification race. As soon as one organization 
implements a certific ation scheme, the othe rs will scramble to implement schemes of 
their own. There could eventually be separate certification schemes fo r the African 
Evaluation Association, American Ev aluation As sociation, Australasian E valuation 
Society, Canadian Evaluation Society, European Evaluation Society, and on down the 
list. This could fragment the evaluation world. In the worst case, the day may come 
when, to work in a certain geographical location, it may be de facto if not de jure 
necessary to hold certification from the regional or national evaluation or ganization with 
jurisdiction in the area. 

Possible Solution 

The question in m y mind is how to get the benefits of certification without 
fragmenting the profession. One possible solution involves the future International 
Organization for Cooperation in Evaluation (lOCE). The lOCE will be a loose coalition 
of regional and national evaluation organizations dedicated to building leadership and 
capacity in developing countries, fostering the cross-fertilization of evaluation theory and 
practice around the world, and assisting the evaluation profession to take a more global 
approach to contributing to the identification and solution of world problems. 

Information about the lOCE is available at the foil owing web site: 
http://home.wmis.net/~russon/ioce/ 




I would submit that, rather than unilater ally implement a certification scheme, 
regional and national evaluation organizations around the world should work tog ether, 
through the lOCE, to collective! y implement a certification or credentialing program. 
What would such a pro gram look like? The lOCE could facilitate discussio n by regional 
and national evaluation organizations about the co urses and field experiences necessary 
for credentialing. Then the lOCE could partner with public and/or private organizations 
to provide courses in ord er to help evaluators from developing countries obtain the 
training necessary for credentialing. The World Bank’s International Programme for 
Development of Ev aluation Training (IPDET) might be a prototype for such training. 
During the lOCE panel at the 2000 AEA conference, Linda Morra (2000) described 
IPDET in the following way: 

we also have launched ... a major evaluation treaty effort called IPDET 
which is the International Programme for Development Evaluation 
Training. What we're doing is linking with Carleton University in Ottawa 
and on June 24-July 20, we are offering about 160 hours of intensive 
training in development evaluation. Ther e will be two weeks o f core 
training in development evaluation with focus on basic evaluation tr aining 
jointly with focus on the issues that are c ritical to development evalu ators, 
but which may not be so critical to others who a re not in the field of 
development. F ollowing those 80 hours of core instruction will be another 
80 hours of electives modeled on the idea o f the Evaluators’ Institute that 
Midge Smith has done so well, but again cent ered on development 
evaluation. The ide a is that all the training sections would use case studies 



10 

that are development case studies and be ve ry applied with lots of 

exercises and opportunities to appl y what has been learned. 

While challeng ing, in my opinion, such a move w ould have a number o f benefits. 
It would increase the quality of evaluation throughout the whole world without the 
divisive effects of competition. If the evaluation profession appro ached funders with a 
unified voice, the prob ability of obtaining funding to support the program would be 
greater than if each organization tried to obtain fun ding separately. 

Conclusion 

In my opinion, the time h as passed when regional and national evalu ation 
organizations can implement major pro grams without considering the effect upon their 
counterparts in other parts of the world. Certific ation is the type of issue that could 
provide short-term benefit for an early adopter, but ultimately be bad for the entire 
profession. I believe that, if we are to undertake certification or c redentiali ng in any 
form, the best way to go about doing it is in a unified manner, leaving no regional or 
national groups behind. 
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Notes 

1 . This article rep resents the views of the author and not necessaril y those of the W. 
K. Kellogg Foundation or the presidents of regional and national evaluation 
organizations helping to create the International Organization for Cooperation in 
Evaluation. 

2. The author wishes to tha nk James Altschuld, Teresa B ehrens, Paul Clements, Mel 
Mark, Anne C. Peters en, and Nancy Porteous for their valuable feedback on an 
early draft of this manusc ript. 
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